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ABSTRACT 

. ^. Effective evaluation for curriculum change m'^ans that 

evaluation must become an integral part of instruction and 
decision- making This integration begins with the first awareness of 
a curriculum problem and is maintained until the curriculum chanae is 
incorpcrated into the regular instructional sequence! six LjoJ^ 
compouents of the evaluation process are given and demonstrated 

""^^^ studies of a reading-mathematics program for elementary 
schools, and a program to provide quality education for the ' 
gifted-talented student. (Author/MLF) 
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We are to explore a very significant subject, "How to Evaluate Proposed 

^ Curriculum Changes." Are children learning? Every publication, at one time or 

another, will carry an article suggesting that children in today's schools aren't 

learning. All sorts of so-called evidence is given; supposedly in support of 
f — ^ 

^ y these critics' claims. 

Boards of Education hear the complaints of critics, of parents, and oftentimes, 
pupils, all suggesting that certain curriculums, or >ortions therein, should be 
evaluated and marked for possible change. As School Board member!, I need not 
remind you of the proportion of your time which must be de^'oted to policy making 
and critical decisions on such matters as financing your districts, budget 
..approvals, reductions in forces, legislation, desegregation, and, if your patrons 
approve bond issues, there are problems of facilities. 

Administrators are also far too busy with efforts to resolve day-to-day 
problems. Again, it is to be remer ibered , that many of the problems being 
addressed-, particularly those which seemingly defy r-solution, are more often 
Chan not the result of faulty or outmoded curriculum. 

Back to the Basics 

This decade will probably be regarded as the period of the "swing back.'' 
"Back to what?" might be the ;ippropriate question. Are schools reflecting the 
social order of our time? Readin' Ritin', 'Rithmatic, and Rubber Hose ... the 
er,sentials ... which somehow are really symptoms th-nt suggest .'■P-ed for an 
evaluation of cur r i cu 1 um with the objective being to moke meaningful clianges. 
School district ills and troubles are generally traceable to certain faulty 
O elements in the teaching/learning process. Researchers know this ... administrators 



know this ... and teachers know it. School Board members know it also. Since 
t.he social revolution of the 1960's. parents of minority children and their 
children themselves feel th^t they aren't be ing taught ; that they are denied 
entry into meaningful curricular areas. Majority parents are saying that their 
children aren't being taught ... that courses are too easy, Watered down, 
wi thou t niean i ng , • 

Obviously, the commentary thus far, is a brief revelation of the type of 
discussion to which citizens, board members, adm : n i s t ra tors and - teache rs are 
coatributors. Evaluation of curricular with the objective to change, places 
considerable demands on a school board and on the administration. 

Why Change ? 

Perhaps your School Board, for the past year, has become a partof the evalua 
and change movement. Reasons most often given are: 
•I) Proliferation of new subject matter, 

2) New processes and teaching techniques. 

3) New theories and education practices. 

k) Community pressures; variety of sources. 

Social influences, governmental influences, guidelines and mandates. 

6) Restatement of goals and objectives 

7) Levels of achievement. 

8) Course sequences. 

9) Promotion and graduation requirements. 
10) Enr 

The listing could be more definitive as well as a great deal n-.ore exhaustive. 
Sensitivity to such concepts is, an early first need in the evaluation process. 
Board /Adnlnistrat ion - A Productive Working Team 

School Board men-.bcr:, and school district employees are collectively responsibl 
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for the quality of education in their districts. Both Board Members and the 
administration must move av;ay from adversary relationships, "^'le evaluation process 
st:arts v/ith a productive working team. 

School district size, experience of Board Members, adm i n i s t ra lor perception, 
are all significant factors in the development of the needed productive 
Board/Administration v;orking team. 

Utilize the uniquenesses of Board Members. Each School Board is lik-ily to 
have one or more members with backgrounds as teachers or as skilled crafts persons. 
The Kansas City Board of Education, composed of nine members, has'a typical range 
of formal preparation ... from a Ph.D. to a high school diploma. The 
occupational range: a retail business proprietor, a banker, a university ^• 
coordinator, a federal employee, tv;o housevnves who were former teachers, and 
tv/o retired persons. The two v;ho are retired [lave unique skills ... one was an 
organizer/supervisor with the post office; the other was an electronics engineer 
v/ith the Bell Telephone System. 

The superintendent is generally :-egarded as the instructional leader of the 
school system. In a small system, he may actually be "the leader'" as the size of 
h i s prof ess iona 1 team wi'l 1 be Correspondingly small. The evaluative process in 
sma I I -^sys terns may begin with the assistdnce of Departments of State Education 
agency, university schools of education, or professional consultant firms. 

The comments which follov; give a brief summary of changes which occurred 
in three curriculum areas in the Kansas City Public School District. The three 
areas are. Read i ng , Ma thema tics and the G i f ted and To lented program. 
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The Process* of Evaluation of Curriculum for Change 

Effective evaluation for curriculum cliange means that evdluation must become 
an integral part of instruction and decision making. This integration begins with 
the first awareness of a curriculum problem and is maintained until the curriculum 
change is- incorporated into the regular instructional sequence. 

The process of eval'jation i nc 1 udes . s i x major components, (See Figure 1) 

1. The Evaluator v^orks with the program planners and operators as 
a team from the beginning of the proposed curricul um xihange. 

The goals, procedures and materials to be used in the 
progra.n are thoroughly understood by the evaluator. 
The requirements and constraints of evaluation are 
equally well understood by the program operators. 

2. The evaluation design emphasizes a multi-modal procedure. 

- Curriculum change is usually complicated and difficult; 
and it is often threatening to teachers. 

- The mul t i-modal approach deals with complexity effectively 
and demonstrates to teachers that the evaluation focuses 
on the curriculum -change and not the individual teacher. 

In the mu 1 t i -nioda 1 procedure, a standardized test may be 
used but it is never "the" evaluation. At best, it is a 
usefuj part of the total evaluation. 

I/iterviews, questionnaires, documentation, test development, 
unobtrusive measures; the multi-modal approach Includes 
, several or all of these procedures. 

3. Formative evaluation is given high priority in the beginning 
stages of curriculum change. 
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Inrormal, non- techn i ca 1 feedback is provided regularly to 
program operators, principals, teachers, top management', 
the Board of Directors and .the community. 
The evaluator identifies areas of strengths; points out 
potential or actual difficulties; provides reassurance that 
the curriculum change is underway . 

- A broad and cons tant ly up-dated perspective on curriculum- 
change- i n-progress gives support and guidance to program 
manage rs . 

Summative evaluation is the "pay-off" and should answer with 
precision these questions: 

- Did this curriculum change achjeve its primary goals? 
(One primary goal is always improved achievement and 
performance by the student.) 

Did the implementation of this curriculum change prove to 
be cost-effective in relation lo outcomes and to 
reasonable alternatives? 
A critique and revision of the evaluative design and its procedures 

- Program manai^ers, program participants, decision-makers 
■ and evaluators all contribute. 

Did the evaluation ask the right questions? 

Did the evaluation provide adequate answers to these questions? 

- What needs to be added, deleted, and modified to produce an 

The improved evoluation design is implemented 

Evaluation of. a major curri-culum change should continue ror 
three to five years to allow the change to become integrated 



Into the regular instructional sequence. 

Each year the evaluation needs a critical review. 

Some curriculum change may require that students be followed 

for six years or longer to assess the total impact. 
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FIGURE 1 

THE PROCESS OF EVALUATION OF CURRICULUM FOR CHANGE 



A SIX-STEP PROCESS 



1. PLAN 
the 
Eval uat ion 
Des ign 



2. SELECT 
Mul ti -RK)dal 
Procedures 



CONDUCT 
Format i ve 
Eva 1 uat ions 



COMPLETE 
Summat i ve 
Evaluation 



5. EVALUATE 
the Eva 1 uat ion 



6. 

IMPLEMENT 

the 
i ntp I oved 

Evaluation 

Des i gn 
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Procedures in Evaluating the Curriculum for Change 

The evaluation process just described best demonstrates its tremendous 
potential in supporting curriculum for change through case studies of its 
application; Two case studies v;i 1 1 be developed in some detail: 

.1. Operation Read/Math: a new reading-mathematics program for 

all elementary schools in the Kansas City, Missouri School District, 
2. The program for the Gifted and Talented: a program to provide 
quality education for the g i f ted- ta 1 en ted student. 

Operation Read/Math: a case study in evaluating the curriculum for chang e 

General av;areness of serious difficulties in the Reading and Mathematics 
curricula for the elementary schools came through the regular evaluation reports 
and the concerns of the professional staff over the i ncreas i ng obso 1 escence of 
instructional materials. When the instructional leadership responded wi t'h, new 
text adoptions and instructional strategies, the Board of Directors gave strong 
budget support and enthusiastic public approval. Thus, Operation Read/M^th as 
a curriculum for change was launched. 

The evaluation of the new Curriculum began at this point. Leadership ^rom 
instruction and evaluation met to plan together. Shortly thereafter, the initial 
evaluation plans were discussed with the instructional support staff and their 
suggestions invited. 

The evaluation design for the initial year was multi-modal and consisted of 
six major components, (See Table One) Each component focused on one major 

r\ n r> t-\ r\ ^ r\r-/-\/-'r*->fv« ~^ ^ ~^ ^ ^ ^ ^^^^ ..a,„'i » , ,( r .* 

and summative evaluations- 
Earlier feedback from evaluation had a powerful influence on several facets 
of the support services. A presentation to the Board of Directors cor.^bined tne 
instructional plans and tfie evaluation strategies into a meaningful whole: 
Operation Rcad/Hatfn g . ■ \ 
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' The- Board v;a5 impressed with the rapid implementation of the program 
accompdnied by a care fu I eva I uo t i on . Botfi the program managers and tfie 
cvcjiuators gained nev/ insights as they participated in rnn extensive public 
prescnLot iofi and responded" to questions from the Board. 

Constant feedback by the evaluators also help to reduce 'the anxiety and 
fears of the support staff and to make th.ir work more effective. For example: 



TABLE ONE 
OPERATION READ/MATH 
An Application of an .Eva 1 uat ion Process to Curriculum for Change 



• va I ua c i on Componen t 



Pu rpose 



I. Pro/post Tes t i ng _( Iowa Tests, of 
Pas i c Sk i 1 1 s 



To eva 1 ua te actii evemen t gains in 
Reading and Mathematics. 



II. Initiation of a longitudinal 
S Ludy 



II. Identification cr classroom 
"organization usetjJ for reading 
instruction 



To evaluate the long range impact of 
Opera t ion Read/Math . 



To assess the re lat ions hip bety^een 
class room o rgan i za 1 1 on and read i ng 
ach ievement . 



IV. Rating. of the quality of reading 
records 



To evaluate the extent to which le^'ichcs 
maintained accurate and comp!^t(: re. ling 
records. 



7. Feasibility of developing tests 
specifically for Operation 
Read/Math 



To analyze the skills test'cd on the 

I ov/a in comparison to the -'skills taught 

in the new curricula. 



VI. Cost-Effectiveness Nodel 



To assess the true cost of achieving 
and maintaining a specific level of 
read i ng ach i evemen t . 



on-site visits to schools by the evaluators working on Component IV indicated that 
some teachers 'were confused about record-keeping procedures. Othi^ir teachers did 
not underst3nd the crucial role or complete and accurate recrocJs v/hen teach rng 
a highly mobile population. As tfie evaluators alerted the support staff to this 
situation, immediate modifications were made in the teacher training schedules. 
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As a consequence, tlic final c^yaroi nat i on of reading records showed a .mucli iroproved 
s i ti/.o t ion . 

As the initi^il yenr of i 1 crr.en Lai i on nioved to a close, Min^motive evalujtMon 
v;a.s coi^-'.i: 1 e t:t::d » Ti:e final evaluation results for Coniponent V provide an effective 
Gx.anp]r of how the perspective of the support staff v/as, changed. The t ns t rue t i qiu; 
staff cha 1 1 enged the use of the i owa as a fncasurc of achievement, thinking that 
the skills tested on the I o were not a good match for those emphasized in 
Operr.Lion Re£:d./Math. The fea^.ibility study conducted by :he evaluators indicated 
an •^;:c/']lent ^;atcr, (over SO per cent) bet\;een skills tvsled on the Icwr. and skill-. 
taught in Cpera}. ion Read/M?. ih . These data helped the evaluators in that the time 
and expense of pcsfible teil: ee ve 1 opivcn t proved u'rin^ces^ ary . 

Corrpo(^-nt Ill^aUc broec^iit' enexp^-c^e: but useful results ic the prGu.\:;Ti - 
(vapcr-: r^; . Tlieii- iiiiuitiv^ feelincs v.ere that so:;-. for;:^s or c!c:M'ocr-i o r i t i on 
were re sep^er;:v^: o ^. r'.-~';;:^j a en i e v-i-e n i tnap oclicrs. The : 1 ua i i ct:- she. ;ed 

t'^at- littte, il J-;;,', r^ I a i; ■ oris! i i p existed bvt:we:..n t;i)e Lwo arri ihet eTforis to 

j 

pro-::-; ore/:n::-:;r i-^ r-.!;n.:;r the:-! .::iOt:w:r | we re not n^ ecs s."- ry . 

The Proc-jfcr. fer^ tr- HI fled and Talented exi-.ted in the District for se' e ye*:" 
By t!ri' e^:r]y sev'.nties. serieji. prog:..: dlfficujLi^s - erg^-d includiri^: en 
jnv^sLi.'eticn b- H:"-!. The . e ] e ,; of a c j - r I cu i urn -;-^p.:e I n 1 1 v ^cr.the 
g i f LC-:: and ta]enti;i steder.: reee^^nieed an d ' - i ippe r : ed lo,: aen= i n i s L r I on 

ai.d tihe Ce.^rd. Co; t.: ^^een t :;/ , I n t i e re v i t. . I i ee t i Oii r:('cr: w/.s r-e;jnt.e:. Par 

of thib r.'v' lal i :: ■ I ion pic^v"^ :.ed-: -::lensive use of e va 1 Uc, l I e^n . 

Oi-e ''if '■.[■■/ ecncern- in ine r-.^v i ta i I red rrrinin.'n v;eL. thvj dt.■:-i^:n o- ^.z'lr arid 

i'nprov.d s-i^;.Li^•n ;: roey .^e : ^ ^ . The old:r pro::ra:' --li^.d on c/. : aptitee- :';t,a:urL' 
and hen resiiU in so:., eie s--. v.'hleh Inekt-d racial b-.lance. Al^.o c; eonc-rn w.-r- 
the fe^t-tcking ^: rn.edu i^- L'--;,.^Ives an.! th.'' r i oe-. vi i f i e u I : i •^ t.h';v \'_:,r 
oduca ; 1 cno i 1 y d i :..n!van v er: ^ : -r.-, 
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A cooperative planning effort was initiated by the leadersfup of Speciji 
Education, the consuit^tnl for tl^o Gifted and Talented Progra.'n, and the Coordinator 
of Testing Services. Over a three-year period^ the selection i :occ6ures for the 
Gifled and Talented Program v/ere constantly improved and extended. (See Fiqurc Tv;o) 
Mow, instead of one entrance for the student to the program, many are available. 

The devloprr.ent of both the teacher and peer nominations r-emoved a bottle-neck 
for those students v/hosc- talents seldom come throi.gii on a paper-and-penci 1 test. 
One form of the teacher nomination^ is for u<e with disadvantaged students and 
recognizes that some potentially Gifted and Talented students may express their 
talents in socially unacceptcb 1 e. v.'ays . In difficult life circumstances, giftedness 
may be expressed negatively as v/e I 1 as positively. 

The peer nomination procedure v;hich is now under devloprnent; is closely related 
to v/ell-known socicrnetric techniques and appears promising. Students arc keen 
evaluators and their insights need to be utilized. 

At this time, the program operators are asking the .wclp of the evalur.ccrs to 
answer these questions: 

1. Do students admitted to the-Gifted and Talented Program on the basis 
of .teaclier nornifnation do as 'well as those admitted by acfnevement or 
ap t i tude tests? 

' ^ 2. What are the potentials of peer nominations in identifying Gifted 
and. Ta 1 en ted students who might be missed by'other procedures? 
As answers for these questions are found, they v;i 1 1 be shared v^ith program 
manage 13. 

With the proposed expansion of the Gifted and Talented Progr:im at tfic^ 
sccofu!.';ry level, other important concr_:rr^.j will emerge. Thus, the. teams from 
i n t r c t i c ri v :: 1 u a t i c n './ill continue to co 0 p r? r a t e in solving instructional 
prcb!:r.':: an^ ! n ; • n ; nc a cu rr I cu I u.'. I'^^'V ch:;n<je In our cltar.g i .-(';; society. 

- 1 1 " 
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FIGURE TWO 



GIFTED /iND TALENTED PROCR/JI 

Many Entrances for the Student through Evaluation 
of Curriculum for Change 



j Achiii^vemGnt 
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SOMF : THIfIGS TO BE DONE 



locked OS a whole should .ict on r^ny picns . 



M.:.ny Boord.s v/CM'k in cof-,;n i t le-js . Be 

•Qin.sLion Ih..- Si^:..rinr. r;.i.:nt. Ke..;, in inlnJ Uua tie has i I y 
brvy of 1 lei.: spite io) i'>is. H.- i. your resource. 
Q';'.isiion Ji.. and chrirt^. 

Don' I r:cci-;.<i. r I wo? Js or pfii-.^^^s 

r,n c r „ . f ; ■ :;. 1 n ' : rh,,: of .:::v o' 



prof'jss io:;.-; ! 1 ::nc^u^.^^ 



J or 



0'.:- .:t T-f,' 



rcr inu- ! . .rri. for,, in n- i nd 



■ I ■ » ■ n ':■ e : 



'..ill c i ' ■<:i r 



Wi:) li-. r.. 



i ^ c!: 



f " ; ■.: U I . 



V/ ; I ] 



i ♦ y j:..: 
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